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I. \  INTRODUCTION 

\^4 

As  noted  in  our  original  proposal,  sost  of  our  effort  has  been  in 
hybrid  analog-digital  algebra  and  in  aassively  parallel  processing  based  on 
holograa  arrays.  Both  prograas  have  exceeded  our  announced  goals  as  will 
becose  clear  from  what  follows.  In  the  process  of  those  priaary  studies, 
we  developed  a  nuaber  of  other  worthwhile  applications  in  optics  as  well. 

Future  work  will  aia  alaost  exclusively  at  the  holographic  inter¬ 
connect  as  this  is  likely  to  be  of  aost  iaaediate  value  in  aeeting 
announced  SDI/ONR  future  prograa  needs  and  we  have  reached  a  satisfactory 
conclusion  to  the  algebra  study  by  laboratory  deaonstratlon  and  theoretical 
justification  of  the  results  previously  obtained  only  by  coaputer  siaulation 
and  justifying  arguaents. 

This  report  is  coaprised  of  overview  and  detail  parts  for  each 
application.  The  detail  is  relegated  to  appendices  to  make  reading  of  the 
overview  aore  convenient. 

II.  OVERVIEW 

2.1  HOLOGRAPHIC  N4  INTERCONNECT 

Despite  the  widespread  belief  that  N4  interconnect  is  iapossible, 
it  has  been  done  for  aany  years.  Fourier  optics  connects  each  of  NXN  input 
pixels  to  each  of  NXN  output  (Fourier  transfora)  pixels.  What  we  have 
sought  so  far  is  a  fixed  full  rank  N4  interconnect  aatrix,  i.e.  N4  fully 
Independent  weighted  interconnection  paths.  When  N  reaches  the  range  of 
100  to  1000,  this  is  aore  parallel  interconnections  than  electronics  will 
ever  achieve  and,  therefore,  establishes  a  unique  niche  for  optics.  The 


probable  application  is  neural  networks. 

Peter  Guilfoyle  for  Opticoap  has  noted  that  sane  unique  niche  for 
optics  in  digital  coaputing.  The  fixed  interconnect  holograas  developed 
during  this  reporting  period  do  not  serve  that  need.  Accordingly,  it  is  a 
goal  for  the  next  period  to  aake  active  N4  interconnects. 

The  highlight  of  this  reporting  period  was  a  careful  exaaination 
of  the  inherent  and  current-technological  constraints  on  N4  interconnection 
using  fixed  holograas.  We  showed  (Appendix  A)  that  with  currently  availa¬ 
ble  coaponents  we  could  aake  (256)4  s  4  x  10*  parallel  interconnections. 
With  redesigned  coaponents,  we  could  sake  (1024) 4  s  10 14  parallel 
interconnections . 


2.2  OPTICAL  ALGEBRA 

According  to  various  estiaates  soaewhere  between  50%  and  75%  of  all 
CPU  time  in  the  United  States  is  spent  in  solving  some  sort  of  linear 
algebra.  Exaaples  include  least  squares  analysis,  antenna  beaa  steering, 
linear  regression,  coaputational  fluid  dynaaics,  finite  eleaent  analysis, 
or  siaply  N  linear  equations  with  N  unknowns. 

Other  nonlinear  algebra  probleas  are  also  iaportant.  These 
include  laage  processing,  linear  prograaaing,  and  super  resolution. 

To  the  extent  that  optics  can  solve  such  probleas  in  a  parallel  7  0TIC 


fashion,  it  can  lead  to  small,  fast  processors  which  would  greatly  iaprov^^p^tD, 
the  utility  of  trackers,  radar,  sonar,  etc. 


Aeeeaslen  For 


WHAT  IS  THE  CURRENT  STATUS? 

We  want  to  solve  probleas  like 
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2  X  ,  t  3  X  2  ♦  X  3 


3xl  +  x2  +  3x3 


3  X  j  ♦  4  X  j  +  7  X  j1 


fWIS  (UMAX 
‘  MIC  TAB 
Unannounced 


I 


Distribution/ 


Availability  Codes 
lAvafiT  and/or 


Diet 


Special 


l 


Ne  can  represent  these  generally  as 


-•  -* 

A  x  -  b. 

In  this  case 


The  aatrix  A  and  the  vector  b  are  given.  We  seek  the  vector  x. 

There  Is  a  way  to  assign  a  single  nuaber  (a  "nora")  to  vectors  and 
aatrices.  We  noraally  use  the  Euclidean  nora,  e.g. 


The  word  "solve"  has  two  different  aeanings.  Ne  presume  there  is  a 
"true"  answer  xT .  Ne  can  say  we  have  an  €-accurate  solution  if 


I  x  -  xT  I  <  e. 

A  weaker  sense  of  "solve"  is 
I  S  -  A  x  I  <  e. 

This  is  weaker  in  the  rough  sense  that  soae  good  solutions  in  this  sense 
aay  not  be  close  to  xT.  On  the  other  hand,  for  aany  probleas,  this  "low 
residual"  solution  is  perfectly  adequate.  The  Binodal  Optical  Coaputer 
(BOC)  ainialzes  the  residual. 

One  speaks  of  coaputatlonal  coaplexity  in  terns  of  how  soaething 
scales  with  soae  resource.  Ne  will  speak  of  spatial  and  tenporal 
coaplexity.  Ne  will  represent  an  NXN  aatrix  in  parallel  using  N*  numbers, 

Ne  say  the  spatial  coaplexity  scales  on  the  order  of  N*.  written  0(N* ).  Ne 
will  show  that  the  teaporal  coaplexity  Is  0(1),  i.e..  independent  of  N, 
provided  that  N  is  saall  enough  to  be  represented  spatially  in  our  processor. 

.,  \ 
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The  nost  basic  concepts  are  over  a  century  old  (due  to  Lord  Kelvin). 

(1)  We  use  a  fast,  low-accuracy  processor  to  obtain  a  first  guess 

(2)  We  use  a  slow,  accurate  processor  to  evaluate  the  residual 

-♦  -* 

ro  “  b  ~  A  V 


If  I  rQ  1  <  e,  stop. 

(3)  Otherwise,  use  the  low  accuracy  solver  to 
solve  for  A  xQ  *  rQ. 

If  we  could  solve  that  probleu  accurately,  then 

*•  ’  V  4  *0 

would  have  zero  residual. 

Thus 

A  Xj  -  A  (Xg  +  A  Xg  ) 

-e  -e 

-  A  Xg  +  A  A  Xg 

*  A  Xg  +  Tg 

-  A  Xg  +  b  ~  A  Xg 

«  b. 


(4)  Use  the  slow,  accurate  processor  to  evaluate 

-e  -e 

Tj  «  b  -  A  Xj 

If  I  Tj  I  <  e,  stop.  Otherwise  go  to  (3). 

Soae  algebra  probleus  resist  accurate  solution  aore  than  others.  In 
high  school  we  solved  N-2  probleus  graphically. 

Equation  1 

Equation  2 


1  K 


The  solution  Is  Xj^,  x2^-  Problens  like  this  are  said  to  be  "well 
conditioned"  and  are  quite  rare  in  real  life.  A  nore  ccaaon  case  is 


Such  problems  are  said  to  be  "ill  conditioned.”  If  the  lines  are  parallel, 
we  say  A  is  "singular.”  Let  us  now  sake  this  soaewhat  more  rigorous.  Let 
us  define  a  "condition  nuaber" 

X  (A)  •  I  A  I  •  I  A'M. 

Then 

e  (I  x  I)  -  x  (A)  e  (P). 

where 

c  (I  x  I)  -  relative  error  in  the  result  and 
e  (P)  -  relative  accuracy  of  the  processor. 

If  we  have  c  (P)  *  0.1  (very  good  optics)  and  x  (A)  *  10  (wonderfully  benign 
problen) , 

e  (I  x  I)  >  1, 

i.e.,  100*  errors  are  likely. 

This  why  we  go  to  32  bit  floating  point  electronics.  No  one  wants  an  answer 

32  9 

accurate  to  one  part  in  2  (*  4  x  10  ) .  We  need  that  to  get  seaningful 

answers  for  large  x.  The  ultimate  ill-conditioning,  singularity,  corre¬ 
sponds  to  Infinite  x.  Such  probleas  are  coaaon. 

In  roughly  1985,  Caulfield  showed  that  this  iterative  process  converges 
(roughly)  if 

e  (P)  <  2x(AT  ’ 


For  good  optica,  e  (P)  ”  0.1.  Thus  we  need 
X  (A)  <  5 

to  guarantee  solution.  This  is  silly.  No  real  problems  are  so  benign. 

In  1987  we  showed  that  replacing  A  by  A'  *  A  ♦  E  where  E  is  an  error 
aatrix  and 

I  B  I  /  I  A  I  I  «  1, 

leads  to  convergence  for  all  problems  independently  of  x.  For  large  x.  the  x 

—a  «+ 

which  alnlalzes  I  r  I  aay  be  less  close  to  xT  than  would  be  the  case  for 
saall  x.  Nevertheless,  we  can  drive  I  r  I  to  zero  in  very  few  iterations 
even  for  singular  matrices.  Call  this  Breakthrough  1. 

To  do  the  fast,  low-accuracy  solution  0  (1)  in  time;  we  use  another 
trick.  We  employ  a  parallel  A  x  ■  y  device. 


These  are  easy  in  optics.  Wai  Cheng  and  Caulfield  showed  that  if  we  correct 
x^  with  a  signal  proportional  to  b^  -  y^.  for  all  k,  then  this  system  would 
"relax  from  any  starting  x  to  one  satisfying  A  x  -  S  (in  the  low  I  r  I  sense) 
under  the  circumstance  that  A  is  "positive  definite."  To  explain  this,  we 
need  one  more  diversion. 

A  vector  e  such  that 
A  e  ■  A  e, 

where  X  is  a  scalar,  is  said  to  be  an  "eigenvector”  of  A.  We  usually  nor¬ 
malize  e.  i.e.  set 

I  e  I  »  1. 

In  that  case,  X  is  the  corresponding  "eigenvalue."  Let  us  arrange  the 
eigenvalues  of  A  such  that 

X,  <  At  <  •  •  •  <  Xr 

(r  connotes  "rank,"  a  concept  we  choose  not  to  define  here).  Interestingly, 


X  (A)  -  1  Ar  |/|  A, | . 

The  Interesting  thing  for  our  purposes  is  that  the  relaxation  processor 
converges  at  a  rate  (roughly)  of 


Obviously  if  A,  >0,  it  does  not  converge.  A  natrix  for  which  A,  >0,  is 


said  to  be  positive  definite.  A  aatrix  B  = 
coluan  switch  to  fora  a  transpose 


[s] 


can  undergo  a  row-for- 
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Since  the  aatrix  eleaents  aay  be  coaplex,  we  can  coaplex  conjugate  a  aatrix  A 
to  get  A*.  He  call 

(A*)T  -  (AT)*  -  AH. 

the  Heraitlan  of  A.  For  any  aatrix  both  AAH  and  A  H  A  are  nonnegative  defi¬ 
nite  (A,  >0).  He  noted  that  AHA  +  E  and  AAH  +  E  are  positive  definite  if 
E  >  0. 

Note .  though , 

A  x  =■  b 

ahax-ah  S. 


Hrite 


B  =■  AHA 


c  -  AH  B. 


B  x  -  c 

and  B  is  nonnegative  definite  (likewise  for  AAH).  Applying  our  aethod  to 
this  aakes  all  aethods  converge  even  though 
X  (AHA)  -  x  (AAH)  -  X2(A). 


a  noraally-disastroua  event.  These  realizations  are  Breakthrough  2. 


Many  other  things  done  in  BOCs  are  pretty,  but  those  two  are  essence. 
Of  the  two,  Breakthrough  1  is  essential.  Breakthrough  2  allows  0  (l) 


solutions . 
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of  an  0  (1)  tiwe  solver  of  even  singular  aatrix  equations  and  the  first  vigorous 


•atheeatlcal  proof  of  how  this  works.  Appendix  B  gives  those  details. 


2.3  PATTERN  RECOGNITION 

In  an  early  part  of  this  contract  we  showed  that  rotation  invari¬ 
ant  pattern  recognition  wanks  such  simpler  to  make  than  those  of  Arsenault 
and  much  simpler  to  use  than  those  of  Sweeny  could  be  made.  These  were 
simply  annular  rings  of  fixed  amplitude  and  phase.  In  Appendix  C  we  show 
experimental  work  which  shows  that  these  simple  filters  actually  outperform 
their  more  complex  competitors. 


2.4  RESIDUE  ARITHMETIC 

In  an  early  phase  of  this  work  we  showed  that  2D  and  3D  optical 
Interconnect  aatrices  which  we  called  optical  Fredkin  gates  offer  soae 
real  advantages  over  other  Interconnection  arrays.  In  Appendix  D  we  show 
that  optical  Fredkin  gates  sake  possible  auch  higher  speed  residue  arithme- 
tic  calculation  chains  than  any  aethod  so  far  proposed. 

III.  CONCLUSION  OF  THIS  PERIOD 

Our  original  goals  on  optical  algebra  have  all  been  set  or 
exceeded.  The  basic  work,  including  theory  and  laboratory  deaonstration. 
has  been  coapleted. 

The  concepts  originated  in  the  prior  reporting  period  for  laprove- 
■ents  in  optical  pattern  recognition  aasks  and  optical  Fredkin  gate  arrays 
have  been  carried  to  the  points  where  they  show  deaonstrable  advantages 
over  prior  methods . 

The  fixed  holographic  N4  Interconnection  system  establishes  that 
optics  can  make  4  x  10*  weighted  independent  interconnections  now  and  10** 
eventually.  These  are  tasks  of  great  interest  in  neural  networks  but  well 
beyond  current  or  projected  electronics  capability. 

Future  work  will  concentrate  on  applications  of  holographic  N4 
interconnections  to  neural  networks  and  to  Peter  Guilfoyle's  digital  computer. 
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